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Motivated by the Quality-of-Service (QoS) buffer management probiem, we consider oniine 
scheduiing of packets with hard deadlines in a finite capacity queue. At any time, a queue can 
store at most b G Z+ packets. Packets arrive over time. Each packet is associated with a non- 
negative value and an integer deadline. In each time step, only one packet is allowed to be sent. Our 
objective is to maximize the total value gained by the packets sent by their deadlines in an online 
^ ' manner. Due to the Internet traffic's chaotic characteristics, no stochastic assumptions are made on 

the packet input sequences. This model is called a finite-queue model. 

We use competitive analysis to measure an online algorithm's performance versus an unrealizable 
^ . optimal offline algorithm who constructs the worst possible input based on the knowledge of the online 

^^ I algorithm. For the finite-queue model, we first present a deterministic 3-competitive memoryless 

^^ ■ online algorithm. Then, we give a randomized (0^ = ((1 -I- \/5)/2)'^ « 2.618)-competitive memoryless 

online algorithm. 
^^ The algorithmic framework and its theoretical analysis include several interesting features. First, 

(<— ^ ■ our algorithms use (possibly) modified characteristics of packets; these characteristics may not be 

00 ! same as those specified in the input sequence. Second, our analysis method is different from the 

^^ ' classical potential function approach. We use a simple charging scheme, which depends on a clever 

modification (during the course of the algorithm) on the packets in the queue of the optimal offline 
algorithm. We then prove that a set of invariants holds at the end of each time step. Finally, we 
analyze the two proposed algorithm in a relaxed model, in which packets have no hard deadlines but 



5^ I an order. We conclude that both algorithms have the same competitive ratios in the relaxed model. 

1 Introduction 

In the last three decades, routers in the Internet continue supporting more and more applications. 
Currently, most routers forward packets in a First-In-First-Out (FIFO) manner and treat all packets 
equally. However, the diversity of applications has resulted in heterogeneity and unpredictable network 
traffic. Thus, it is more reasonable to consider differentiation among packets from different types of 
applications (see [23l [H |T71 [2] and the references therein). For instance, we could specify values for 
packets to represent their priorities. Also, we may like to assign hard deadlines to packets in time- 
critical applications. These concerns have made buffer management at routers significant in providing 
effective quality of service (QoS) to various applications. 

* Uepartmcnt of Computer Science, George Mason University, lifeiacs.gmu.edu. Part of this work appears in the Proceedings 
of the 28th IEEE International Conference on Computer Communications (INFOCOM 2009) [19]. 



One kind theoretical research on QoS buffer management starts from three paper by Aiello et al. [T] , 
by Kesselman et al. |17J and by Hajak [15], where a model called a bounded-delay model is proposed. In 
this model, time is discrete. Packets arrive over time, and they are buffered upon arrivals. The queue 
capacity is unlimited. An arriving packet p has a non-negative value Wp S M"*" and an integer deadline 
dp € Z"*" by which it should be transmitted; after dp, p expires. In each time step, at most one packet 
can be sent. The objective is to maximize the weighted throughput, which is defined as the total value 
of the transmitted packets by their deadlines. Fig. [T] illustrates the functionalities of the online buffer 
management algorithms, which process newly arriving packets and send one packet out of the buffer in 
each time step. The buffer size and deadlines of packets limit the number of pending packet^ in the 
queue. 



Input packets 




Outgoing stream 



Figure 1: Buffer management is in charge of processing arriving packets from the input streams and 
delivering packets out of the buffer as outgoing streams. 

Realizing that the capacity of a queue buffering packets is limited and such queue is a shared resource 
for multiplexing packets inside routers, Azar and Levy extend the single buffer bounded-delay model 
to multiple buffers. They consider scheduling packets with deadlines in multiple finite capacity buffers, 
all of which have the same finite capacities [S]. In this paper, we study the single queue scheduling 
problem, in which the capacity of the queue is finite. 

In the ideal case, if the release time, value, and deadline of each packet are known ahead of time, an 
optimal schedule can be found efficiently; we call this the optimal offline algorithm. For instance, given 
no constraint over the queue capacity, the the optimal schedule can be found by computing a maximum 
weighted matching on a convex bipartite graph. However, we do not know all such information ahead of 
time. Rather, packets arrive online, and we only learn about a packet and its associated characteristics 
when it actually arrives. Furthermore, without a realistic model of the network traffic |23lll4j . we cannot 
achieve good stochastic performance guarantee. Hence, we study the worst-case analysis for algorithms 
in queueing packets, without any assumptions over the input sequence. 

Competitiveness has been widely accepted as the metric to measure an online algorithm's worst- 
case performance in theoretical computer science [9]. In this paper, we design and analyze better 
deterministic and randomized online algorithms, in terms of competitive ratio, for scheduling packets in 
a finite capacity queue. A deterministic (randomized) online algorithm ONd (ON.r) is called k-competitive 
if its (expected) weighted throughput on any instance is at least 1/k of the weighted throughput of an 



'^A pending packet is a packet in the buffer whose deadline has not expired yet. For a given time step, every pending packet is 
eligible for sending. 



optimal offline algorithm on this instance: 

OPim -a . , ...,., 

k = max -— — , ON^ is a deterministic algorithm 

X DNd(T) 

OPT(T) -a . ,.,,., 

K = max —7 J— TT , ONr is a randomized algorithm 

J E[ONr(T, r)]' ^ 

where a is a constant, OPT(T) is the optimal solution of an input T, and r is the set of random variables 
fflpped by a randomized online algorithm ON^.. The parameter k is known as the online algorithm's 
competitive ratio [9] q If /c is not a constant, such an algorithm with competitive ratio k is called 
non- competitive. If the additive constant a < 0, the algorithm ON^ (ON^) is called strictly k- competitive. 
Note that for a randomized algorithm, the role of randomization is purely internal to the randomized 
algorithm. No stochastic assumption is made on the input. Also note that the optimal offline algorithm 
is called the adversary of the online algorithm since the input sequence constructed by the offline optimal 
algorithm is allowed to maximize the competitive ratio k. 

1.1 Problem setting. The model we study here is called the finite queue model, in which we consider 
scheduling packets with deadlines in a finite capacity queue. In our model, time is discrete. Packets 
arrive over time and each packet p is associated with a non-negative weight Wp G M^ and an integer 
deadline dp £ Z+. dp specifies the time by which p should be sent. If p is transmitted by its deadline 
dp, p contributes our objective by a value Wp. (We use "value" and "weight", "queue" and "buffer" 
interchangeably.) This model is preemptive, which means that packets already existing in the queues 
can be dropped at any time before they are served. If a packet is dropped, this packet cannot be 
delivered any more. 

There is only one queue with a limited capacity of 6 G Z"*". At any time, the queue can store no 
more than b packets. Packets that expire are dropped immediately. At most one packet can be sent 
in each time step. Our target is to maximize the total value of the packets sent by their deadlines. 
Remember that in a bounded delay model [T71 [15], the queue capacity is infinite. The finite queue 
model generalizes the bounded delay model: if the queue capacity is larger than any packets slack time, 
which is defined as the difference between the packets deadline and its release time, the finite queue 
model is the bounded-delay model. 

1.2 Related work. Since the first QoS buffer management model (the bounded-delay model) was 
introduced in [H [2] , many researchers have considered this model as well as its variants \n\ [T5l W\\ [TOl 
121 EQI Ell IS] . Most of these studies consider the single queue case, which does not have an explicit limit 
over the queue capacity. The best known lower bound of competitive ratio of deterministic algorithms 
is (f) = {1 -\- \/5)/2 ~ 1.618 [15 ^ 111 ^ ^]: this lower-bound also applies to instances in which the deadlines 
of the packets (weakly) increase with their release dates. 

For an arbitrary deadline instance, a simple greedy algorithm that always schedules a maximum- 
value packet in the queue is 2-competitive \Vb\ I17j . A generalization of the greedy algorithm, called 
EDFq,, which schedules the earliest packet with a value at least 1/q [a > 1) of the maximum-value 
of a packet [ID], has a competitive ratio of (asymptotically) 2. Chrobak et al. [T2] discuss a clever 



"^In real-time scheduling terminologies, 1/k, the reciprocal of the competitive ratio, is called competitive factor. We use the term 
competitive ratio, which is widely recognized in the area of online computation. 



modification that results in an algorithm with a competitive ratio of 64/33 ~ 1.939. This algorithm 
employs a status bit to help schedule packets and hence, it is not memoryless q 

For instances in which the deadlines of the packets (weakly) increase with their release dates, Li et 
al. [20] propose an optimal deterministic online algorithm MG whose competitive ratio is (j). Unfortunately, 
this improved competitive ratio is achieved by exploiting the deadline assumption; on general instances, 
MG, like the greedy algorithm and EDFq,, is also 2-competitive. Applying similar analysis approach, but 
in a more complicated way, Li et al. provide a 3/(/) ~ 1.854-competitive deterministic algorithm [20] for 
the general model. Independently, Englert and Westermann present a 1.894-competitive deterministic 
memoryless algorithm and a (2\/2 — 1 ~ 1.828)-competitive deterministic algorithm [13], which is not 
memoryless. Closing the gap of [1.618, 1.828] between the lower bounds and the upper bounds of 
competitive ratio of deterministic online algorithms is still a difficult open problem. Randomization on 
the bounded-delay model is considered in [TU]. A randomized online algorithm with a competitive ratio 
of e/(e — 1) ~ 1.582 is proposed. The lower bound of competitive ratio of randomized algorithms is 
1.25. How to tighten the gap of [1.25, 1.582] in the randomized model still remains open. 

Azar and Levy consider the multi-buffer model in which multiple queues are bounded in their 
capacities and packets can have arbitrary deadlines. Notice that if the queues are unlimited in capacities, 
this model is the same as the bounded-delay single queue model. The lower bound 1.618 for the 
bounded-delay model directly applies on the multi-queue model. In [5| , the authors give a deterministic 
memoryless 9.82-competitive algorithm. In this paper, we improve the lower bound to 2 for a family 
of deterministic online algorithms (this lower bound also applies to the finite queue model). To our 
knowledge, there is no published work of randomized algorithms on the multi-buffer model. Also, 
our proposed single finite queue model, which is more realistic for buffer management, has not been 
addressed in recent literature. For the single queue case, the competitive ratio of the algorithm in [5] 
9.82 still applies. 

There has also been work on another model in which the queue capacity is bounded. In this model, 
packets have no deadlines but weights, and the FIFO discipline is enforced in delivering packets [221 [TBI [8] 
— packets should be sent in the same order as they arrive. Some researchers also consider packet 
scheduling in multiple FIFO input queues connecting one output queue [6l [3 O [16] : Every queue obeys 
the FIFO constraint in delivering weighted packets and each arriving packet has only one destined queue. 

1.3 Our contributions. This paper provides theoretical bounds for algorithms on the finite queue 
model, which considers the finite capacity constraint for buffer management under a more practical 
modeling. Our main contributions include 

1. A strictly 3-competitive deterministic memoryless online algorithm ME for the finite queue model 
(in Section [2]). 

2. A strictly [(jp' = ((1-|- v5)/2)^ ~ 2.618)-competitive randomized memoryless online algorithm RME 
for the finite queue model (in Section [3]). 

3. A new analysis method including a charging scheme and a set of invariants. 

Table [1] summaries the competitive ratios of those known algorithms for the bounded-delay model, 
its variants, and our results on the finite queue model. 



•^An algorithm is called memoryless if this algorithm makes its scheduling decision only based on the packets in the current queue 
but not on the historical information. 



Models 


Upper bound of competitive ratio 


Lower bound of competitive ratio 


General bounded-delay 
model 


Deterministic algorithms: 1.854 [21j 
1.828 [13] 

Randomized algorithms: e/(e — 1) ss 
1.582 LlO] 


Deterministic algorithms: 1.618 [17l 

m 

Randomized algorithms: 1.25 [lOj 


Agreeable deadline 
bounded-delay model 


Deterministic algorithms: 1.618 ^20j 


Deterministic algorithms: 1.618 |17l 

m 


General finite queue 
model 


Deterministic algorithms: 3 (in this 

paper) 

Randomized algorithms: 2.618 (in 

this paper) 


A broad family of deterministic al- 
gorithms: 2 (in this paper) 



Table 1: Summary of competitive ratios for the bounded-delay model and the finite queue model. Upper 
bounds are achieved by some known algorithms. Any online algorithm cannot achieve a competitive 
ratio less than the lower bound. 



To supplement our work on the finite queue model, we also provide an optimal offline algorithm (in 
Section HD. 

2 Algorithm ME and Its Analysis 

In this section, we introduce a deterministic memoryless online algorithm ME to schedule packets with 
deadlines in a single finite capacity queue. ME stands for "Modified EDF". We first discuss the intuitions 
behind the algorithm ME. Then, we present ME and its analysis. 

2.1 Intuitions of designing ME. We commence our study at a well-known real-time scheduling 
algorithm called EDF ("Earliest-Deadline-First"). EDF is one of the most important (and ever analyzed) 
dynamic priority algorithm, and the priority of a job (or a packet) is inversely proportional to its absolute 
deadline. In each time step, EDF schedules the packet with the earliest deadline [10]. The following 
example shows that even EDF calculates the best schedule sequence among all pending packets, it does 
not have a constant competitive ratio for the finite queue model Q In this example, the queue capacity 
is 6 G Z^ and we use {w, d) to represent a packet with value w and deadline d. We use d = cxd to denote 
a packet with a very large deadline. 

Example 1. Initially, the algorithm's queue is empty. In the first time step, 6—1 packets of (e, i), 
i = 1, 2, . . . , 6—1 and one packet (1, oo) arrive. In each of the following 6 — 2 time steps 2, . . . , 6—1, 
only one packet (1, oo) is released to the queue. 

When a new packet arrives, EDF tries to accept it and drops the minimum- value packet only if the 
queue is overflow. EDF sends the earliest-deadline packet in each time step. In our instance, EDF sends 
the packet (e, i) in each time step i = 1, 2, . . . , 6 — 1 and all released packets (1, oo) are stored in its 
queue till the end of step 6—1. On the contrary, the optimal offline algorithm sends one packet (1, oo) 
in each of the first 6—1 time steps, and only one packet (1, oo) remains in its queue at the end of step 
6-1. 



*Such an algorithm is called non- competitive. 



At the beginning of step b, EDF's queue is full and has b packets (1, oo). Now b packets of (1 — e, 2 • b) 
arrive but since they have weights smaller than the packets already in the buffer, they are dropped. 
Notice that EDF has lost 6 — 1 packets of (1 — e, 2 • b) due to the overflow happening in step b. At the 
beginning of each step 6 + 1, 6 + 2, . . . , 2-6, one packet (e, 6 + i) (i = 1,2,..., 6) arrives. Given 
that all packets already in the queue keep their deadlines oo, EDF sends packet (e, 6 + i) in each time 
step. On the contrary, the offline optimal algorithm sends (1 — e, 2 • 6) in each step. 

At the beginning of step 2-6 + 1, 6 packets of (1 — e, 3 • 6) arrive and EDF's queue has a packet 
(1 — e, 3-6) and 6—1 packets (1, oo). EDF sends a packet (1 — e, 3-6) in step 6. Notice that EDF has 
lost 6—1 packets of (1 — e, 3-6) due to the overflow happening in step 2-6+1. At the beginning of 
each time step 2- 6 + 2, 2-6 + 3, ..., 3 - 6, one packet (e, 2-6 + z) (i = 2, 3, ..., 6) arrives. Given that 
all packets already in the queue have deadline oo, EDF sends the packet (e, 2 - 6 + i) and keeps those 
in the queue without worrying about them being expired, hoping to send them in the future. On the 
contrary, the offline optimal algorithm sends (1, oo) in each time step. 

We repeat this pattern. In the interval between 2 overflows (a period of 6 time steps), the optimal 
offline algorithm sends 6 large- value packets with value 1 — e and EDF sends only one large-value packet 
and 6—1 small value packets with value e. We find that EDF cannot achieve a total value more than 
1/6 of what an offline optimal algorithm does. Assume we run n rounds of the same pattern of released 
packets. EDF sends all packets (1, oo) after n rounds. The competitive ratio c of EDF is (assume n-e = 1) 

l-6+(l-e)-6-n + e-6 6 , 1 
> :: t:: — ; tt-t- > 6 



[e - (6 - 1) + 1] - n + 1 - 6 " 1 + (2 - 6 - l)/n " 1 + n/(2 - 6 - 1) ' 

Given 6 is large and if we repeat above pattern for at least 1/e times, EDF is not competitive in 
scheduling packets with deadlines in the finite capacity queue because the competitive c is not bounded 

by a constant. D 

Example [T] reveals that even EDF keeps the set of pending packets with the maximum total value in 
each time step, it is not competitive. The underlying idea of using EDF is that we do not drop any packet 
p unless p is going to expire at time dp or in the queue, there are more packets with no less value than 
Wp having to be sent before dp. The non-competitiveness of EDF over the above instance implies that 
we need a better method to identify whether a more valuable packet should be sent even well before its 
"real deadline". For example, packet (1 — e, oo) released in step 6+ 1 in Example [1] should be sent early 
instead of being overflowed by later packets. Thus, it is critical for us to define and associate a "virtual 
deadline" with each packet, instead of the real deadline assigned, to denote the "best latest time" by 
which a packet should be sent. Inspired by the EDF instance in Example [H we propose an algorithm ME, 
which keeps track of a packet's importance with respective to the others by using its "virtual deadline". 

2.2 Algorithm ME. At first, we introduce some notation. A packet p arrives at an integer time 
Tp G Z+. p has a non- negative value Wp £ M+ and an integer deadline dp G Z^. Given a time t, we 
denote the buffer of an algorithm A to be Q^. All buffer slots in Q^ are indexed as 0, 1, . . . , 6 — 1. We 
use Qtii) to denote the packet in the buffer slot indexed as i. If there is no packet in a buffer slot i, 
Qt{i) is a null packet. We associate each packet p a virtual deadline tp. At p's arrival, tp is initialized 
as its real deadline specified by the adversary in the input sequence. 

Given a set of pending packets, a provisional schedule specifies which packet should be sent in which 
time step no later than its virtual deadline, assuming no future arrivals. Given a set of pending packets 

6 



with virtual deadlines, an optimal provisional schedule is the one that achieves the maximum total value 
of packets among all provisional schedules on pending packets. The optimal provisional schedule gives 
a greedily optimal schedule of all the pending packets at time t: If there is no future arrivals, sending 
the packets each in one time step following the optimal provisional schedule is optimal for maximizing 
the total gain. 

We develop our algorithm ME from our considerations on the EDF instance in Example [TJ ME consists 
of 3 parts: 

1. Based on the virtual deadlines of packets, calculate the optimal provisional schedule of sending 
the pending packets in the queue (including the new arrival in this time step), assuming there is 
no future arrivals (see Algorithm [1]) . 

2. Update the virtual deadlines of packets, if needed (see Algorithmic]). 

3. Send the packet with the earliest virtual deadline or the maximum- value packet, based on the 
ratio of these two packets (see Algorithm [2]) . 

Assume for each packet p, we have known its virtual deadline tp. The following procedure OPS (OPS 
stands for "Optimal Provisional Schedule") greedily calculates the optimal provisional schedule from 
the set of pending packets S at time t. In OPS, we first sort packets in non-increasing weight order. 
Then we pick up a packet p and put it into an empty queue as later as we could. If we cannot find such 
an empty buffer slot for p, this packet is discarded. All packets selected to be put into the queue are 
claimed to be in the optimal provisional schedule. OPS is described in Algorithm [TJ 

Algorithm 1 OPS(S, t) 

1: Sort all packets in S in non-increasing weight order, with ties broken in favor of the larger virtual 
deadlines. 

2: while S / do 

3: Pick up a packet p from S. 

4: for each buffer slot i indexed from minjtp — t, 6 — 1} down to do 

5: if there is no packet in the buffer slot indexed as i then 

6: Put p into the i-th. buffer slot. 

7: Remove p from S. 

8: Break. 

9: end if 

10: end for 

11: if p is not added into the queue then 
12: Discard p. 

13: end if 
14: end while 

15: Sort all packets in the queue in non-decreasing virtual deadline order, with ties broken in favor of 
the larger value packets. 

Using an interchange argument, we prove the optimality of OPS. 
Lemma 2.1. OPSf'Sj calculates the optimal provisional schedule for a set of pending packets S. 

7 



Proof. In the algorithm OPS, for each packet p, we either move p into the queue or we permanently 
discard it. We finalize the provisional schedule 5" in a greedy manner. To prove Lemma 12.11 it is 
sufficient to prove that for each packet p in the optimal provisional schedule S* , S and S* choose the 
same set of packets to put into buff'er slots [S{p) — t, 6 — 1], where S{p) denotes the time step in which 
p is put into S{p), given the set of pending packets and the assumption of no future arrivals. Without 
loss of generality, we assume all packets in S* are sorted in non-decreasing deadline order, with ties 
broken in favor of the larger value packets. 

We assume there exists an optimal provisional schedule S* . 11 S = S* , Lemma [2 . 1 1 holds immediately. 
Let us assume S ^ S*. We then compare the packets scheduled in S and S* from the buffer slot indexed 
as 6 — 1 in reverse order, q is the first packet appearing in the schedule S* that is different from its 
counterpart in S (in the backward manner) and the corresponding time slot in S contains p. A packet 
p ^ q must be found. 

We apply the interchange argument to prove S = S*. From our procedure of selecting packets in 
OPS, we know that any packet in a queue from S{p) to its virtual deadline tp has a value larger than or 
equal to Wp. 

1. If Wq > Wp, then, q should be chosen before p when we create S and q should be put in the position 
S{p) instead of the position of p. 

2. li Wq < Wp, the optimal provisional schedule S* should contain p since it includes q (tp and tq are 
not before the time slot S* schedules q). Without losing any value, S* can swap p and q since p 
is not in any buffer slot from S*{p) to tp. 

Thus, in this step, both S* (after swapping p and q) and S schedule the same packet p. Lemma |2. II is 
proved. ■ 

Now, we present the algorithm ME. ME consists of maintaining packets in the queue (including selecting 
packets and updating their virtual deadlines) and delivering a packet at the end of each time step. For 
each new arrival p, its virtual deadline tp is initialized as its real deadline dp. If there are more than one 
packet arriving, we consider them one by one. The deadline dp is specified by the adversary at its arrival. 
Then we calculate all existing packets in the queue and p to find the optimal provisional schedule from 
time t. After we obtain the optimal provisional schedule, we update some packets' virtual deadlines, if 
necessary. Each packet updates its virtual deadline to the tentative time step specified in the optimal 
provisional schedule. At last, we send either the packet with the earliest virtual deadline (if it has a 
sufficient large value), or the maximum- value packet (otherwise). ME is described in Algorithm [2j 

Directly from the algorithm ME, for each p G Q^^, we conclude the following properties of its virtual 
deadline tp-. 

Remark 1. All packets p € Q^^ have their tp sorted in strictly increasing order as t, t + 1, . . . , t + 
\Q^\ — 1, where \Q^\ is the number of packets in the queue. So, unless a new arrival p conies with its 
virtual deadline tp = dp > t + \Q^^\ — 1, accepting p will lead to dropping exactly one packet in Q^^. 

Remark 2. Every time when tp is updated (if any), tp is decreased strictly. For any packet p E Q^^, 



'"p S t-p ^ Up. 



Remark 3. All packets in the buffer have distinct virtual deadlines, which may not be the same as their 
deadlines specified in the input sequence. 



Algorithm 2 ME(S, t) 



1: For each new arrival p, set tp = dp. 

2: Calculate the optimal provisional schedule S* by running OPS(Q^^ Up, t). 

3: Drop all packets not in S*. 

4: Update the virtual deadline tj of a packet j G S* as t + i {< dj), where i is the index of the buffer 

slot that j is residing in the optimal provisional schedule queue. 

{Notice that Qf (i) = j.} 

{Let the packet with the earliest virtual deadline be e, let the maximum-value packet be h, with 

ties broken in favor of the earliest virtual deadline.} 
5: if We > Wh/ct then 
6: Send e. 
7: else 
8: Send h. 
9: end if 

{Lines 5 to 9 are as in EDFq [12].} 

2.3 Analysis of ME. 

Theorem 2.1. ME is a deterministic 2>- competitive algorithm, for scheduling packets with deadlines in 
the finite queue model, where the parameter a in the algorithm is set 2. 

Fix an input sequence of arriving packets. The actions of the algorithm can be regarded as a 
sequence of packet arrival events and packet delivery events r := tiT2 ■ ■ ■■ Then, in our algorithm ME 
and its analysis, if not mentioning, we use the subscript t to denote the event r^, instead of the time 
step t. A single time step may involve more than one arrival events and only one delivery event. 

In analyzing online algorithms, potential function approach and charging scheme are two commonly 
used methods [9]. The potential function method assigns some values as the potentials to the online 
algorithm and the adversary's configurations respectively, and then compares the change of the potentials 
in each time step to bound the competitive ratio. In our analysis, we use a modified potential function 
to prove Theorem 12. 1[ We let ADV denote the adversary of ME and O denote the set of packets sent 
by ADV, i.e., the packets in the optimal solution. Without loss of generality, we assume ADV sends the 
earliest deadline packet in each time step. Let the packets sent by ADV be pi, p2, ■ ■ ■ , Pi, ... in order. 
A packet pi G O is delivered in step i. If there is no packet to send in step t, pt is a null packet. 
Our analysis (especially for packet arrivals) depends on a critical observation on the adversary and a 
property of ME: 

Remark 4. Assume in steps 1, 2, ..., i, n, ADV sends packets pi, p2, ■■■, Pi, ■■■, Pn in order. 
Clearly, rp. < i < dp.. Furthermore, in ADV's queue, we are free to modify the packets' deadlines dp. to 
t' as lonq as r„. < i < t' . 

Remark 5. For any packet j in ME's queue, the minimum value of a packet i with ti < tj does not 
decrease over time. 

We use $f^ (respectively, <1*^°^) to denote the potential of the queue of ME (respectively, ADV) at time 
t. $f^ (respectively, $f°^) is the sum of the (mapped) O-packets (respectively, O-packets) in the queue. 



Define 5* as the packet sent by an algorithm A. Our goal is to prove that at the end of each event, the 
following inequality 

3.Y.w,+<^T> y: ^k+^r, (2.1) 

holds. As a consequence, this yields Theorem 12.11 

Let Af^ (respectively, Af°^) denote the difference of the left (respectively, right) side of Inequalitv l2.1l 
from time t — 1 to time t, i.e., 

Af := 3- Y. m + '^r-'^T-i, (2.2) 

iG{Sf\5fii) 

A*°^ := Yl Wk + ^r-^^l\. (2.3) 

Obviously, Inequality 12.11 holds before the first event since packets have not been sent so far. In 
order to prove Theorem 1, it is sufficient to prove that for each event, the following inequality holds 
since it leads to Inequality 12.11 

Af > Af ^ (2.4) 

In order to prove Inequality [231 we present a set of invariants which hold at the end of each event. 

h. Af > Af^ 

l2- ADV's queue contains only the set of packets it will send. For each packet j G (Qf^ H Qf°^), ADV 
has the virtual deadline tj as its real deadline. 

For each packet j £ Q^, j maps to at most one packet j' G (Qi°^ \ <3t^). For each packet 
p' G (Qt°^ \ Q"^), p' must be mapped uniquely by a packet p G Q^. 

h- If j £ QT' maps to j' G {Qf^ \Q"^)) for any packet i G Qf^ with ti < tj, the following inequalities 
are true: U < dji and Wi > Wji. 

We prove that the set of invariants hold separately for both the events of packet arrivals and packet 
deliveries. Summing these inequalities over the arrivals and deliveries happened in one single time step 
yields the claim for a single time step; summing over all time steps proves Theorem 12.11 To prove the 
existence of the above set of invariants, we apply case study in the following. 

Proof. We show the set of invariants hold at the end of each time step. For each time step, we consider 
packet arrivals and packet delivery separately. In the following case analysis, we update the packets in 
ADV's queue as well as their mappings to the packets in ME's buffer. 

If not mentioned otherwise, everything else remains unchanged at the end of this event. For ease of 
presentation, we assume buffer slots are indexed as 1, 2, . . . , b. We use O to denote the set of packets 
sent by the adversary. Let e and h denote the packets with the earliest virtual deadline and the packet 
with the maximum value, with ties broken in favor of the earliest virtual deadline one. Remember all 
packets in the queue have distinct virtual deadlines (see Algorithm [1] and Remark [3]) . 

We are going to show that in each time step, the ratio of ADV's gain over ME's gain is bounded by 
1 + a, or 1 + 3/a, or 2 + 2/ a. The competitive ratio 3 is optimized at a = 2 for 

minmax{l + a, 1 + 3/a, 2 + 2/a}. (2.5) 
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2.3.1 Packet delivery In each time step, ME either sends e or h. If ME sends e, Wg > Wh/a; otherwise, 
ME sends h. We assume ADV sends j. At the end of this dehvery event, e is out of ME's queue because 
of its virtual deadline. We summarize all the possible consequences into the following 5 cases, based on 
the packet ME sends and the packet ADV sends in each step. 

1. Assume ME and ADV send the same packet j. 

We charge ME Wj. We charge ADV Wj initially. If j ^ e, i.e., j = h and we know Wh > a ■ We- We 
charge ADV more We + Wg' +Wj', where e' is the packet mapped by e and j' is the packet mapped by 
j, if any. From the invariant I3, inax{W(,', Wj'} < We- Thus, the ratio of the modified gain for ADV 
and ME is bounded by max{(tt;e + We')/^e5 {we + We' + Wj + Wji)/wj} = max{2, 1 + 3/a} = 1 + 3/a, 
where a = 2. 

2. Assume ME sends e and ADV sends j ^ Q^- 

From the invariant I2, we assume j = p', and j is mapped by a packet p G Q"^. Since ME sends e. 
We > Wh/a. 

(a) Assume e = p. 

We charge ME We and charge ADV Wj < Wp = Wg. Then the ratio of the modified gains is 

Wj/We < 1. 

(b) Assume e ^ p and e is not in any mapping. 

We charge ME We and we ADV We + Wj (given e possibly being an O-packet). Then the ratio 
of the modified gains is {we + Wj)/we < {we + Wh)/we < 1 + a. 

(c) Assume e ^ p and e maps e' G <5f°^. 

We have de> > dj, otherwise, ADV will select e' to send (because we assume ADV selects packets 
to send in the earliest deadline order). Thus, dg' > dj = dp' > tp (the third inequality holds 
because of the invariant 12). Also, p ^ Q*^^, otherwise, since tp = dp < dj, ADV will send p 
instead of j. 

We charge ME We and we charge ADV We' + Wj. Then the ratio of the modified gains is 

{We' + Wj)/We < (We + Wh)/We = 1 + a. 

3. Assume ME sends e and ADV sends j G Qf^, & ¥" J- 

We > Wh/a > Wj/a. e ^ Qt^^ , otherwise, ADV will send e instead of j in this step. 

We charge ME We- We charge ADV We' + Wj, assuming e maps e'. Then the ratio of the modified 
gains is {we' + Wj)/we < 1 + a. If j maps a packet in ADV's queue only, this mapping still holds 
at the end of this delivery event. 

4. Assume ME sends h ^ e and ADV sends j ^ QY'- 

Note We < Wh/a. From the invariant I2, we can assume p £ Q^^ maps p' = j € (Qt^^ \ Q^)- 
Since ADV sends p' and dp/ > tp (from the invariant I2), we know p ^ Qt^^ ■ Thus, Wj = Wpi < We- 
h should be in Qf^"^, otherwise, ADV can send h instead of j to gain more value in this time step. 

Also, Wh' < We- 
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(a) Assume e = p. 

e is out of ME's queue at the end of this event because of its virtual deadhne expires. Then 
we charge ME Wh. We charge ADV We + We' + Wh + w^', assuming e maps e' = j and h 
maps h'. Note inax{we', w^'} < "Wg < Wh/a. Then the ratio of the modified gains is 

{we + Wf,' + Wh + Wh')/wh < (3 + a)/a = 1 + 3/a. 

(b) Assume e ^ p. 

Assume e ^ p and e maps e' G Qi°^- We have d^' > dj, otherwise, ADV will select e' 
to send (because we assume ADV selects packets to send in earliest deadline order). Thus, 
de' ^ dj = dpi > tp. 

We map p to e'. We charge ME Wh and we charge ADV w^ + w^' + We + W(,i- Then the ratio 
of the modified gains is {we + Wgi + Wh + Wh')/wh < 1 + 3/a. 

5. Assume ME sends /i / e and ADV sends j G Q^, J ¥^ h. 

Clearly, tj = dj < t^ = d^, otherwise, ADV can always swap the sending sequences of j and h. h 
should be in (5j°^, otherwise, ADV can send h instead of j to gain more value in this time step. 

Also, Whi < We- 

(a) Assume j = e. 

We charge ME Wh and charge ADV w^ + Wh' + We + w^', assuming e maps e' and h 
maps h' . maxjttJe', Wh'} < We < Wh/oc- Then the ratio of the modified gains is 

{Wh + Wh' +We + We')/Wh < 1 + 3/a. 

(b) Assume j / e. 

e is not an O-packet. Assume e maps e' in ADV's queue; if e' does not exist, we let e' be a 
null packet. W(.i < We- Note Wji < We- At the end of this delivery, j is still in ME's queue but 
j is not in ADV's queue. 

We charge ME Wh- Then, we charge ADV Wh + Wh' + Wj + We'- Then the ratio of the modified 
gains is {wh + Wf + Wj + We')/wh < (wh + We + Wh + We)/wh = 2 + 2/a. 

2.3.2 Packet arrivals Remember that from the properties of algorithm ME (see Remark [1] and 
Remark [2]), for each new arrival p, if admitting p results in a packet i leaving Qf^, the total value 
of the queue is not decreasing, p can always be a candidate packet to map the packet which was 
mapped by the packet evicted due to accepting p (since Wp > Wi). Also, the slack time of p, defined as 
dp — t, is no larger than the total number of packets in the queue \Q^^\, otherwise, p will be accepted 
by ME without evicting a packet (see Algorithm [1]) . 

For each arriving event at time t, Sf^i \ Sf^ = Qj+\ \ <5t°^ — ^- Thus, for each new arrival event, 
we only need to consider the change of mappings, if any. 

From the property of the adversary, we know that all packets in ADV's queue (supposed to be sent 
by ADV) will not be evicted when we put new O-packets in ADV's queue. Let us consider the case when 
introducing an O-packet p results in a packet i leaving ME's queue. If i is not in ADV's queue, we are fine 
with all mappings and potentials because there is no loss to <l>f^. We only consider the case when i is 
in ADV's queue. 

Assuming i is an O-packet in ADV's queue, we first claim that we can always find a packet q, which 
is not in ADV's queue with Wq > Wi. Otherwise, ADV does not accept p as well. Then we collect all 
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O-packets in ME's queue but with deadlines < IQf^l, as they are need to be dehvered by ADV by time 
t + \Q^^\, it does not hurt to assign them deadhnes in strictly decreasing order from t + \Qf^\- Therefore, 
the evicted O-packet i can be assigned a deadline as the virtual deadline of the latest non-O-packet 
in a buffer slot no later than dj — f in ME's queue. Let this packet be j. We can remove i from ADV's 
queue and put j with tj as its deadline and Wj as its value in ADV's queue. These operations do not 
hurt ADV because of Remark [5l Above reasoning can also be applied to the case when a new O-packet 
p is rejected by ME. 

Based on our case study at packet arrival events and packet delivery events discussed above, 
Theorem 12.11 is proved. ■ 

Some side research results on the finite queue model are shown as follows; they give the upper and 
lower bounds that (some) online algorithms can achieve. 

We use St to denote both the provisional schedule for time steps [t, -|-cxd) and the set of packets 
specified by the schedule. All known online algorithms for the bounded-delay model [17], [15], [11], 
[20], [21]) [E] calculate their optimal provisional schedules at the beginning of each time step. These 
algorithms only differ by the packets they select to send. The deterministic online algorithms in such a 
broad family are defined as the best- effort admission algorithms. 

Definition 1. Best-effort admission algorithm. Consider an online algorithm ON and a set of 
pending packets P^ at time t. i/ON calculates the optimal provisional schedule St on Pt o.nd selects one 
packet from St to send in the step t, we call ON a best-effort admission algorithm. 

Theorem 2.2. The lower hound of competitive ratio for the best- effort admission algorithms is 2. 

Proof. In the following instance, we will show: // the buffer size is bounded, the packets that the optimal 
offline algorithm chooses to send may not be from the optimal provisional schedule calculated by the 
online algorithm, even if both algorithms have the same set of pending packets. This property does not 
hold in the bounded-delay model; and it leads that any deterministic best-effort admission algorithm 
cannot achieve a competitive ratio better than 2. 

Assume the buffer size is h. Let a best-effort admission online algorithm be ON. We use {wp, dp) to 
represent a packet p with a value Wp and a deadline dp. Initially, the buffer is empty. A set of packets, 
from which the optimal offline algorithm will accept 6 — 1 packets from them and eventually send, are 
released: (1, 6+1), (1, 6 + 2), ..., (1, 6 + 6). Based on its definition, upon these packets' arrival, ON 
will select all of them to put into its buffer. Notice that all packets released have deadlines larger than 
the buffer size 6. The optimal offline algorithm drops (1, 6 + 1), and keeps (1, 6 + 2), . . . , (1, 6 + 6) in 
its buffer. 

In the same time step, 6 packets (1 + e, 1), (1 + e, 2), . . . , (1 + e, 6) are released afterwards. There 
are no more new packets arriving in this step. The optimal offline algorithm only accepts (1 + e, 1). 
Thus, after processing arrivals in step 1, the optimal offline algorithm send the packet (1 + e, 1). Instead, 
ON calculates the optimal provisional schedule in step 1 which includes all these newly arriving packets 
with value 1 + e. All such packets will be accepted by ON, but the packets (1, 6 + i), Vi = 1, 2, . . . , 6, 
will be dropped due to the buffer size constraint. ON sends a packet with value 1 + e in the first step. 

At the beginning of each step i = 2, 3, . . . , 6, only one packet (1 + e, i) is released. At the end 
of step 6, no new packets will be released in the future. Since the time after the first step, all packets 
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available to ON have their deadlines < b. Thus, ON cannot schedule sending packets with a total value 
> (1 + e) • (6 — 1) in the time steps 2, 3, . . . , b. 

Of course, since there is one empty buffer slot at the beginning of each time step i = 2, 3, . . . , b, the 
optimal offline algorithm can accept and send all newly released packets (1+e, i) in steps i = 2, 3, . . . , b. 
At the end of step b, the packets (1, b + 2), (1, 6 + 3), . . . , (1, b + b) are still remained in the optimal 
offline algorithm's buffer (they are not in ON's buffer though). Since there is no future arrivals, these 6 — 1 
packets will be transmitted eventually by the optimal algorithm in the following 6 — 1 steps. The total 
value of ON achieves is (1 + e) -6 while the optimal offline algorithm gets a total value (1 + e) -6 + 1 -(6- 1). 
The competitive ratio for this instance is 

(1 + e) -6 + 1 -(6-1) 1 + 6-e 2 , , 

"-^^ ^ ' -'^ >2--, ife-6 = land6>2. 



(l + e)-6 6 + 6-e " 6' 

If 6 is large, ON cannot perform asymptotically better than 2-competitive. This lose is due to ON 
calculating optimal provisional schedule to find out the packet to send in each time step. Theorem 12.21 
is proved. ■ 

Lemma 2.2. The simple greedy algorithm, which selects packets in the optimal provisional schedule and 
sends the maximum-value packet in each time step, is no better than 4:- competitive. 

Proof. In the following instance, we will show that the greedy algorithm Greedy, which calculates 
the optimal provisional schedule and schedules the maximum- value packet, cannot be better than 4- 
competitive. Let the buffer size be 6. Without loss of generality, we assume 6 is even. We use {wp, dp) 
to represent a packet p with a value Wp and a deadline dp. 

Suppose at the end of step 0, the buffer is empty. A set of packets, which the optimal offline 
algorithm will eventually send, are released: (1, 6 + 1), (1, 6 + 2), . . . , (1, 6 + 6). Notice that all 
packets in the buffer have deadlines larger than the buffer size 6. 

At the beginning of step 1, 6 packets (1 + 1 -e, 1), (1 + 2-e, 2), ..., (1 + 6-e, 6) are released. Greedy 
accepts all these newly arriving packets. The optimal offline algorithm only accepts (1 + e, 1), drops 
(1, 6 + 1), and keeps (1, 6 + 2), . . . , (1, 6 + 6) in its buffer. In step 1, the optimal offline algorithm send 
(1 + e, 1). Instead, Greedy will accept all newly released packets in step 1, thus, all packets (1, b + i) 
for any i = 1, 2, . . . , 6 are dropped. Greedy sends the packet (1 + 6-e, 6). At the end of this step, 
the packet (1 + 1 - e, 1) in Greedy's buffer expires. 

At the beginning of each step i = 2, 3, . . . , 6, only one packet (1 + e, i) is released. At the end of 
step 6, no future packets will be released. Greedy rejects all these newly released packets. Greedy will 
send the packets (1 + (6 - 1) - e, 6 - 1), (1 + (6 - 2) - e, 6-2), . . . , (1 + (6/2 + 1) - e, 6/2 + 1) in the 
following 6/2 - 1 time steps. All the packets (1 + 2-e, 2), (1 + 3 - e, 3), . . . , (1 + (6/2) - e, 6/2) wifl be 
dropped due to their deadlines. 

Of course, the optimal offline algorithm can send all newly released packets in steps 2, 3, . . . , 6. At 
the end of step 6, the packets (1, 6 + 2), (1, 6 + 3), ..., (1, 6 + 6) are still remained in the optimal offline 
algorithm's buffer, but not in Greedy's buffer. Since there is no future arrivals, these 6 — 1 packets will be 
transmitted eventually by the optimal algorithm in the following 6—1 steps. If 6 is large, Greedy cannot 
perform better than 4-competitive. The lose is due to Greedy's first step in which optimal provisional 
schedule is used in selecting packets in the buffer and its greedy manner in sending packets in the first 
6/2 time steps. Lemma 12.21 is proved. ■ 
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3 Algorithm RME and Its Analysis 

In this section, we present a randomized algorithm for the finite capacity queue model. Our algorithm 
is named RME, which stands for "Randomized ME". Similar to ME, RME consists of two parts in handling 
packet arrivals and packet deliveries respectively in each time step. The difference is that RME employs 
a random variable to decide whether to send the earliest packet or the most valuable packet. 

We would like to point out that even RME makes a random choice during its execution, this 
randomization is executed by the algorithm internally and has nothing to do with the characteristics of 
the input sequence. The adversary is allowed to generate the input sequence to maximize the competitive 
ratio. No stochastic assumption is made on the input sequence. 

3.1 Algorithm RME. For each packet arrival event, RME works the same as what ME does. That is, 
RME calls OPS(S,t) to identify the packets in its buffer deterministically, where S is the set of pending 
packets and t is the current time. In packet delivery, a random variable f3 is used to facilitate scheduling. 
We use e to denote the packet with the earliest-virtual deadline packet and h to denote the earliest 
maximum value packet in the buffer. The algorithm works as follows. If e has a sufficiently large value 
with We > Wh/oi, we send e deterministically. Otherwise (i.e., Wg < Wh/ot), we choose /? uniformly on 
[0, 1]. If /5 S [0, 7] (we will decide 7 later. The parameter 7 influences the competitive ratio of the 
algorithm), we deliver e, otherwise (i.e., if /3 G (7, 1] and We < Wh/a), we deliver h. The pseudo code 
of RME is described in Algorithm El where the set of pending packets at time t is S. 

Algorithm 3 RME(S, t) 

For each new arrival p, set tp = dp. 

Calculate the optimal provisional schedule S* by running 0PS((5f^ Up, t). 

Drop all packets not in S* . 

Update the virtual deadline tj of a packet j G S"* as t + i, where i is the index of the buffer slot that 

j is in. 

if We > Wfi/oi then 

Send e. 
else 

Choose (3 uniformly on [0, 1]. 

if /? G [0, 7] then 
Send e. 

else 
Send h. 

end if 
end if 



3.2 Analysis of RME. 

Theorem 3.1. RME is a randomized (cjP' ~ 2. 618) -competitive algorithm, for scheduling packets with 
deadlines in the finite queue model, where a = (p ^ 1.618 and 7 = 1/0^ ~ 0.382. 

Some formulas are used in our analysis: 

1/^ + 1 = (j), (/. + l = </.2, 2 + 1/(1) = ^'^, (/) + l/</.2 = 2. 
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Proof. At first, we examine the expected gain that the algorithm RME can gain in a time step. From the 
algorithm itself, we know that RME gains. 

We, if We > Wh/a, 

We, if We < Wh/a and (3 G [0, 1/0 ], 
Wfi, if We < Wh/a and /? G (1/0 , !]• 

In either way {we > Wh/4> or We < Wh/(l)), the algorithm gains an expected value of 

B{Wt) > mm{wh/(^, We ■ (1/0^) + Wh ■ {I - 1/0^)} = Wh/(t>. 

Remember S^ is the packet sent by an algorithm A. We observe the following set of invariants about 
ADV and RME's buffers: 



ADV 

t ' 



Vi. 

jesf^ jesf"- fees'*™ 

where linearity of expectations is used in the first equality. 

¥2- ADV's queue contains only the set of packets it sends. For each packet j G {Q™^ n Qf^^), ADV has 
the virtual deadline tj as this packet's modified real deadline dj. 

For each packet j G Q™^, j maps to at most one packet j' G {Qf^^ \ Q™^)- For each packet 
p' G (Qt^^ \ Q™^), p' must be mapped uniquely by a packet p G Q™^- 

Vs. If j G Qf ^ maps f G {Qf" \ Qf^), for any packet i G Qf ^ with U < tj, U < dj, and Wi > Wj,. 

Similar to the analysis of ME, packet arrival and delivery events are analyzed separated from case 
studies. We omit the analysis on packet arrival, which has been presented in the proof of Theorem 12. 1[ 
In the following, we discuss the invariants in the randomized packet delivery events. 

In each time step, RME either sends e or h. If RME sends h, we must have Wh > a ■ We = 4> ■ We 
(from the algorithm). We assume ADV sends j. At the end of this delivery event, e is out of RME's queue 
because of its virtual deadline. We study the following cases which are categorized based on the packet 
RME sends and the packet ADV sends in each time step. 

1. Assume RME sends e and We > Wh/4>- 

As what we have seen in the proof of Theorem 12.11 the ratio of the modified gain is bounded by 

l + a = l + = 02_ 

2. Assume RME sends e with We < Wh/4'- 

This case happens with a probability of l/cjP' when We < Wh/fp- We combine this case with the 
next case to get the expected competitive ratio. 

3. Assume RME sends h ^ e and ADV sends j ^ h. 

This case happens with a probability of l/(f> when We < Wh/4>. e leaves the buffer at the end of 
this delivery due to its virtual deadline. We assume j 7^ e. 
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(If j = e, we just ignore all Wj and Wj' in our following calculation and all inequalities still hold 
with simpler representations. If j = /i, we simply use h to replace j in the following calculation 
and all inequalities hold also.) 

We categorize the cases with e is in a mapping and e is not in a mapping. 

If e is in a mapping, e is sent with a probability of l/(/)^ and h is sent with a probability of l/fp. 
In the first case, we charge ADV We + w^i where e maps e'. In the second case, we charge ADV 
We + We' + Wj + Wh'- Thus, the expected competitive ratio is 



ADVi 



E(RMEt) 



^) • (2 • We) + (1/0) • {We + We' + Wj + Wh') 2We + <f> ■ 2We + </> • 2Wh 



(l/(/)2) • We + (1/0) -Wh We + 4>-Wh 

/0) + 20 • /l _ 2 + 2/0 + ^ 



^ (20 + 2)(wfe/0) + 20-/i _ 2 + 2/0 + 20 ^ 



If e is not in a mapping, e is sent with a probability of 1/0^ and h is sent with a probability of 
1/0. In the first case, we charge ADV Wj < w^- In the second case, we charge ADV Wj + Wh + Wh'. 
Remember We > Wh' (see the invariant V3). Thus, the expected competitive ratio is 

ADVi 



E(RMEi) 

_ (1/0^) • Wj + (1/0) • {Wj +Wh + Wh') ^ Wh/(ty^ + {Wh + Wh + We)/(t) 

(1/02) •u;e + (1/0) -u;/, - We/4'''+Wh/(t) 

Wh + 2 ■ (p ■ Wh + (p ■ We ^ 2 ■ (j) + 1 2 

< < = (p . 

We + (t>-Wh 

Based on the above analysis, Theorem 13. II is proved. ■ 

4 The Optimal Offline Algorithm and Its Analysis 

Let O denote the set of packets sent by an optimal offline algorithm. Our algorithm is simple. Fix 
an input sequence T. We start from a set of packets So C T such that all packets in So = S can be 
delivered successfully if we send them in increasing order of deadlines. Given a set of packets S, we 
get the total gain of H^(S). If Sq = X, the algorithm is optimal. If So 7^ I, then we study the set of 
packets X\ So. We sort all packets in X\ So in increasing order of deadlines. For each packet j, adding 
j into So generates a new set S; this results at most one packet i not being sent successfully (still under 
the earliest deadline policy). Then we run into a loop to pick up a packet i £ S with Wi < Wj and 
see whether W{S U {j} \ {i}) > W{S). {i can be a null packet such that S U {j} \ {i} = S U {j}. If 
W{S U {j}) > W{S U {j] \ {i}) > W{S), we add j into S. If W{S U {j}) < W{S U {j} \ {i}), we drop i. 
We iteratively move j out of T \ So into S until X \ So is empty. We claim that the schedule we finally 
have is optimal. It depends on the following two theorems. 

Theorem 4.1. Given a set of packets S, if all packets can be sent by their deadlines with the buffer size 
constraint, we can always schedule them in increasing order of deadlines among all pending packets in 
the buffer. 
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Proof. This is a standard result. ■ 

Lemma 4.1. So is easy to be construct. We simply pick up the earliest deadline packet to send and in 
each time step, greedily accept packets. 

Theorem 4.2. If a set of packets S can be delivered successfully, S U {j} results at most one packet 
unsuccessfully sent. We can pick up any packet i with Wi < Wj as the candidate and schedule Su{j}\{i}. 
IfW{Su{j}\{i}) >W{S) butW{Su{j}) <T^(S), i^O. 

Proof. This is due to the property of matriod. ■ 

Theorem 4.3. The optimal offline algorithm runs in polynomial-time 0{n^), where n is the size of the 
input sequence. 

Proof. Given a set of m packets S, sorting all packets in S (in order of increasing deadlines) takes time 
0{m ■ logm). For each packet not in S but not discarded yet, we take time 0{m) to locate a packet 
i with value Wi < Wj and then we schedule S U {j} \ {i} (note that i can be a null packets such that 
S U {j} \ {i} = S U {j}). It takes time 0{m) to get the total gain of a schedule. Thus, identifying 
whether to accept j or to discard j takes time 0{m'^). Let the set of packets in the input sequence be 
n with n > m. The total running time of our algorithm is bounded by 0{n ■ n^) = 0{n^). ■ 

5 Conclusions and Open Problems 

In this paper, we present two online algorithms for scheduling weighted packets with hard deadlines 
in a finite capacity queue and we provide their theoretical competitive analysis. The model we study 
generalizes the extensively studied bounded-delay model for QoS buffer management. Our model has 
significant importance in real system design since it takes into account of the realistic bound on the 
size of the router queues. The deterministic memoryless algorithm we present is 3-competitive and the 
randomized memoryless algorithm we present is {(f)^ ~ 2.618)-competitive. Both algorithms provide the 
worst-case guarantees to robustly optimize our objective (maximizing the weighted throughput) without 
applying any stochastic assumptions over the packet traffic. We propose a novel analysis approach by 
updating packets' parameters in an online manner. Instead of using the real deadlines, we introduce 
virtual deadlines, which are updated over time to help us make the best decision on when to send the 
packets. The virtual deadlines are strictly decreased over time and they guarantee the hard deadlines 
are always satisfied. This idea can be applied in many other online and real-time problems. 

Closing or shrinking the gap of [1.618, 2.618] between the lower bound and upper bound of 
competitive ratios for this model is an open problem. For a broad family of online algorithms, including 
all previously known research for the bounded-delay model, the lower bound is 2. Our algorithmic 
framework can be applied to the multi-buffer model [5]. Getting an algorithm better than 9.82- 
competitive for the the multi-buffer model is still an interesting open problem. 
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